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In early 2015, the Reform Support Network brought together State department 
of education leaders from Colorado, Delaware, New Jersey and Tennessee to 
discuss strategies for refining and sustaining high-quality educator evaluation 
systems. During the convening, representatives from the Tennessee Department 
of Education (TDOE) explained how the State shares evaluation data with districts 
to help them make strategic decisions about human capital issues. TDOE created 
a “human capital report,” a district-specific report that provides data on a range of 
human capital metrics, including the percent of teachers whose growth scores do 
not align with their observation rating, teacher attrition by level of effectiveness 
and new hires by level of effectiveness. Following each metric, the report asks 
districts a series of guiding questions to help them analyze the data and identify 
next steps. Included here is TDOE’s presentation from the meeting, along with a 
sample report for a mock district. States can use these materials to reflect on how 
they are helping districts use evaluation data to more effectively manage their 
human capital. 


The Reform Support Network, sponsored by the U.S. Department of Education, supports the Race to 
the Top grantees as they implement reforms in education policy and practice, learn from each other, 


and build their capacity to sustain these reforms, while sharing these promising practices and lessons 


learned with other States attempting to implement similarly bold education reform initiatives. 
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Changing the State Role 


Year 1 Year 2 Year 3 Year 4 


makielalayss (Colaaleliryaracw-lale, =¥-Taallatcarelare, man) eXe))cialatcarelare, 
Implementation Wifolalixe)alays slar-lalays4 (Co) | EV ekole-arals4 


TENNESSEE DEPARTMENT OF 


EDUCATION 7 


Human Capital Report 


=" Goal: More intentionally connect evaluation data with other human 
capital metrics to provide districts with actionable, thought- 
provoking data 
=" Compiled using 2013-2014 evaluation data 
= Range of human capital topics, including: 
e Evaluation 
¢ Growth and Development 
e Retention 
° Hiring 
= Includes data that districts have seen, as well as new metrics 
= Paired with a self-assessment tool to ensure the data are actionable 
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Rollout 


= Previewed the first draft with 20 districts in fall 2014 


= Met with regional directors and evaluation coaches, who will be 
delivering the data, multiple times to develop plan for sharing 


= Three-pronged approach: 
e One-on-one conversations with each district 
e Study council or Professional Learning Community (PLC) session 
¢ Direct email to director of schools 
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Report Summary 


= Includes multiple tables, each followed by some guiding questions 
for further thought: 
e Distribution of scores 
e Alignment between individual growth scores and observation scores 


¢ Change in individual growth scores from 2012-2013 to 2013- 
2014 


¢ Persistently high versus persistently low performing teachers 
¢ Teachers who left district by level of effectiveness 

e Teachers who moved within district by level of effectiveness 

¢ New hires by level of effectiveness 

e Level 1 observation hours 
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Change itn Individual Growth Scores 
from 2012—2014 to 2013-2014 


2013-2014 Individual Growth Scores 
1 20.0% 250% 5.0% 40.0% 10.0% 
(20 teachers) 
(4) (5) (1) (8) (2) 
2 40.0% 0.0% 20.0% 0.0% 40.0% 
(50 teachers) 
(20) (10) (20) 


5.0% ar 10.0% 0 on 50.0% 
(40 ae 
(12) (20) 
0. an 7 aa a om 20.0% 50.0% 
(50 eee 
09 (10) (25) 
ecoreens | ca TT 20.0% 50.0% 
100 teachers 
50) 
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2012-2013 Individual Evaluation 
Composites 


Persistently High Versus Persistently 
Low Performing Teachers 


Persistently Low | Persistently High 


Performing Performing 


30.6% 
(4 out of 49) (15 out of 49) 


8.9% 45.3% 
(1,331 out of 14,924) | (6,757 out of 14,924) 
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Definitions 


=" Persistently high performing: A teacher who has 
three years of individual growth with a sum greater than 
or equal to 13. 


= Persistently low performing: A teacher who has 
three years of individual growth with a sum less than or 
equal to four. 
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Teachers Who Left District Based on 
2013-2014 Overall Level of Effectiveness 


Total 
Overall Level Total Teachers Total Moved 
of Teachers | Retained Teachers Districts eeeied 
Effectiveness in District Who Left 


Teachers who moved from your district went to: District A (4), District B (3), District 
C (3), District D (1), District E (2) 
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New Hires in 2014—2015 Based on 
2013-2014 Overall Level of Effectiveness 


District: Total District: Percent | State: Percent of 
Teachers of Teachers Teachers 


16.6% 
100.0% 
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Self-Assessment Tool 


= Groups the tables into parts of the human capital continuum: 
¢ Evaluation Implementation 
¢ Development and Professional Learning 
¢ Retention 
¢ Hiring and Selection 
= Gives rationale for why each component Is important 


= Asks districts to rate their level of proficiency on a series of 
statements 


= Provides a matrix to help districts decide where they want to focus 
= Provides potential strategies for next steps and improvement 
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Case Study: Mid-Sized Rural District 


= Based on these tables: 
e What are some promising or troubling trends you see? 


e What human capital decisions would you be able to make based on the 
data in these tables? 


e What additional information might you need? 


e If you were this district, what next steps would you take in regards to 
these data? 
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Case Study: Large Urban District 


= Take a look at tables 3, 4, 5, and 7: 
e What are some promising or troubling trends you see? 


e What human capital decisions would you be able to make based on the 
data in these tables? 


e What additional information might you need? 


e If you were this district, what next steps would you take in regards to 
these data? 
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Next Steps 


= District follow-up: 


¢ Regional directors will track districts’ levels of engagement with the 
tools. 


¢ Our division will reach out to districts with high levels of engagement to 
learn about what next steps they took. 


¢ We will compile practices and share out. 


= Incorporate in data system: 
e Featured report to populate homepage at different times of the year 
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Challenges 


Deciding what data to include 
Making the data actionable 
Valuing the input of multiple stakeholders 


Automating the generation of reports 


Ensuring follow-up 


Contact Information 


= Paul Fleming, Interim Assistant Commissioner of Teachers and 
Leaders, Tennessee Department of Education 


e Paul.Fleming@tn.gov 
= Courtney Seiler, Deputy Director of Evaluation, Tennessee 


Department of Education 
¢ Courtney.Seiler@tn.gov 


TENNESSEE DEPARTMENT 
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Human Capital Data Report 
Mock District 


This Human Capital Data Report was compiled using 2013-14 data and covers a range of human capital topics, including 
evaluation, retention, and hiring data. It includes data previously shared via the fall Evaluation Completion Reports, but 
also incoporates new metrics not previously available. This report is intended to be used in coordination with the Human 
Capital Self-Assessment Tool which is designed to aid in data analysis, present possible strategies for improving human 
capital management, and aid in prioritizing implementation of those strategies. 


Section |: Evaluation 


Table 1: Distribution of Scores 


Teachers | Percentis | Percent 2s | Percent 3s | Percent 4s | Percent 5s 
w/ Data 
Overall Level of 100 of 100 10.0% 30.0% 20.0% 10.0% 30.0% 
Effectiveness 
Overall Level of 0.8% 11.2% 25.2% 31.5% 31.3% 
Effectiveness (State) 
Observation Average 100 of 100 10.0% 20.0% 10.0% 30.0% 30.0% 
Observation Average 0.3% 2.7% 22.4% 43.3% 31.3% 
(State) 
Growth Score: 100 of 100 10.0% 10.0% 30.0% 20.0% 30.0% 
All Teachers 
Growth Score: All Teachers 22.5% 9.0% 19.4% 10.6% 38.5% 
(State) 
Growth Score: Teachers w/ | 100 of 100 10.0% 30.0% 10.0% 30.0% 20.0% 
Individual Growth 
Growth Score: Teachers w/ 19.7% 9.6% 24.2% 11.5% 35.1% 
Individual Growth 
(State) 
Achievement Measure 100 of 100 10.0% 10.0% 30.0% 20.0% 30.0% 
Achievement Measure 10.6% 5.9% 17.7% 15.8% 50.1% 
(State) 
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Guiding Questions: 


Is this the distribution you expected? 

Do you see any measures that seem out of line with the rest of the measures? If so, why do you think this may 
be? 

Do you anticipate this distribution changing notably this school year? If yes, why? If no, why not? 

How does your district’s distribution compare to the distribution at the state level? Why do you think this may 
be? 


Table 2: Alignment between Individual Growth Scores and Observation Scores 


Number of Teachers with District Average District Average State Average 
Observation Scores and Individual | Percent Aligned or | Percent Misaligned | Misaligned by Three 
Growth Scores within Two Levels by Three or More or More Levels 
Levels 
40 out of 50 90.0% 10.0% 12.5% 


Guiding Questions: 


1. 


Are you concerned about the level of misalignment in your district? Why or why not? 

Can you identify why there might be a discrepancy between individual growth and observation scores? 

Do you have some schools where misalignment might be more of an issue than others? If so, what are you doing 
to combat misalignment in those schools? 

Are you concerned about the quality of feedback teachers are receiving? Are you more concerned about this in 
your schools with higher rates of misalignment? 
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Section 2: Growth and Development 


Table 3: Change in Individual Growth Scores from 2012-13 to 2013-14 


In this chart, cells highlighted in green represent teachers whose individual growth score improved between 2012-13 
and 2013-14. Also highlighted in green is the cell showing teachers who maintained an individual growth score of 5 
between 2012-13 and 2013-14. 


2013-14 Individual Growth Scores 
1 
1 5.0% 
20 teacher(s) 
rf (1) 
8 2 20.0% 
$ 10 teacher(s) 
2 (2) (1) 
=4 3 20.0% 0.0% 20.0% 
3 50 teacher(s) 
3 (10) (0) (10) 
on 4 0.0% 0.0% 0.0% 
ay 10 teacher(s) 
8 (0) (0) (0) 
5 0.0% 0.0% 40.0% 
5 teacher(s) 
(0) (0) (2) 


Guiding Questions: 


Did more of your teachers improve their individual growth scores than not? 

Which group of teachers were you most effective at growing? 

Are there any district-wide practices that have led you to be more effective at moving some groups of teachers? 
Do you know which teachers had big growth score changes and why? 

(NOTE: This change could be in either direction and may be related to changes in grade and subject taught.) 


sai oat te 
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Section 3: Retention 


Table 4: Persistently High vs. Low Performing Teachers 


Persistently Low Performing 


Persistently High 


Performing 
rie 25.0% 75.0% 
District 
(5 out of 20) (15 out of 20) 
8.9% 45.3% 
State 


(1,331 out of 14,924) 


(6,757 out of 14,924) 


There are many ways to define to persistently high and low performing teachers, for the purpose of this report they are 
defined as follows: 


A persistently high performing teacher is defined as a teacher who has three years of individual growth with a sum 
greater than or equal to thirteen (13). For example, a teacher who scored a 4 in 2011-12, a 4 in 2012-13, anda 5 in 
2013-14 would have a sum of 13, making this teacher persistently high performing. To be considered persistently high 
performing, a teacher had to have an individual growth score of 5 for at least one year, and could not have received an 
individual growth score of 2 in any of the three years. 


A persistently low performing teacher is defined as a teacher who has three years of individual growth with a sum less 
than or equal to four (4). Ateacher who scored a 1 in 2011-12, a 2 in 2012-13, and a 1 in 2013-14 would have a sum of 
4, making this teacher persistently low performing. To be considered persistently low performing, a teacher could not 
have received an individual growth score of 3 in any of the three years. 


Guiding Questions: 


Is this distribution what you would expect? 

Do you know who these teachers are? 

Do your persistently high performing teachers know who they are? 

Do you have any recognition or retention practices in place, specifically for teachers who have demonstrated 
strong performance over time? 

5. Do you have any practices in place to develop and support your persistently low performing teachers? 


Be NUE 
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Table 5: Teachers who Left District Based on 
2013-14 Overall Level of Effectiveness 


Overall Level | Total Teachers | Total Teachers | Total Teachers Moved Not Rostered? 
of Retained who Left Districts 
Effectiveness 
1 10 2 8 2 6 
2 15 7 8 1 7 
3 12 1 11 0 11 
4 10 8 2 2 0 
5 6 5 1 0 1 


> Teachers who moved from your district went to: District A (3), District B (2) 


Guiding Questions: 
1. Are you retaining your high performing teachers at a higher rate than your low performing teachers? 
a. If so, how are you accomplishing that? 
b. If not, why do you think this might be and what could you do to change it? 
2. What is the primary reason teachers are exiting your district? 
3. Are teachers exiting your district to go to other districts at a rate that is concerning? 
4. Which districts are your teachers leaving for and why? Are these the districts you would have expected? 


1 Teachers may fall into this category for a number of reasons, including but not limited to: retirement, exiting the profession, exiting 
the state, maternity leave, medical leave, leave of absence. 
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Table 6: Teachers who Stayed in District but Moved Schools 
Based on 2013-14 Overall Level of Effectiveness 


Overall Level of 1 2 3 4 5 
Effectiveness 
10 Teacher(s) 0 2 4 3 1 


Guiding Questions: 


1. Which teachers are moving schools within your district? High performing teachers or low performing teachers? 
Why is this? 

2. Is the movement of high performing teachers resulting in better access to great teachers for low performing 
students? 

3. Do you know which schools are recruiting teachers from within the district and why? 

4. Why do you think teachers are accepting these within district transfers (Ex. school culture, teacher leader 
opportunities, other leadership opportunities, physical location, etc.)? 
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Section 4: Hiring 


Table 7: New Hires in 2014-15 Based on 2013-14 Overall Level of Effectiveness 


District: Total District: Percent of | State: Percent of 
Teachers Teachers Teachers 
Newly Hired in 
40 80.0% 45.3% 
Tennessee 
Level 1 0 0.0% 5.0% 
Level 2 2 4.0% 5.4% 
Level 3 1 2.0% 12.3% 
Level 4 1 2.0% 15.4% 
Level 5 6 12.0% 16.6% 
Total New Hires 50 100.0% 100.0% 


> Teachers who moved to your district came from: District A (7), District B (3) 


Guiding Questions: 
1. Where are you getting most of your new teachers? Why is this? 
2. Do you have a robust support system for teachers who are new to teaching in Tennessee? 
3. From which district do most of your new teachers come? 
4. Did you ask teachers to share previous evaluation data as part of your hiring process? If yes, what information 
did they share? If no, why did you not ask for this information? 
5. What recruitment strategies do you have in place to insure you are attracting high performing teachers? 
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Table 8: Level 1 Observation Hours Breakdown 


Task Total Hours 
Initial Coaching 
; 0.5 
Conversation 
Announced? Observation 1 2.0 
Unannounced? fe 
Observation 1 , 
Announced Observation 2 2.0 
Unannounced 46 
Observation 2 : 
Summative Conference 0.5 
Total 8.0 


Table 9: Level 1 Observation Hours 2014-15’ 


Total Teachers Percent of Teachers Observation Hours Total Hours 


District: 


5 3.8% 8 per teacher 40 
Level 1 


Guiding Questions: 
1. Does this align with the amount of support you are prepared to provide to struggling teachers? 
2. How are these hours of work distributed amongst your evaluation team? 
3. What additional supports are you providing to these teachers outside of the required minimum? 
4. What percentage of these teachers do you anticipate improving based on this support? (NOTE: /t may be helpful 
to look at the chart on pg. 4.) 


2 Announced Observation: Pre-Conference-0.5 hrs., Observation-1 hr., Post-Conference-0.5 hrs. 
3 Unannounced Observation: Observation-1 hr., Post-Conference-0.5 hrs. 
4 A teacher is on the Level 1 track if he or she received a 1 on individual growth or Overall Level of Effectiveness. 
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